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We consider the coupling between two networks, each having N nodes whose individual dynamics 
is modeled by a two-state master equation. The intra-network interactions are all to all, whereas the 
inter-network interactions involve only a small percentage of the total number of nodes. We demon¬ 
strate that the dynamics of the mean field for a single network has an equivalent description in terms 
of a Langevin equation for a particle in a double-well potential. The coupling of two networks or 
equivalent coupling of two Langevin equations demonstrates synchronization or antisynchronization 
between two systems, depending on the sign of the interaction. The anti-synchronized behavior is 
explained in terms of the potential function and the inter-network interaction. The relative entropy 
is used to establish that the conditions for maximum information transfer between the networks are 
consistent with the Principle of Complexity Management and occurs when one system is near the 
critical state. The limitations of the Langevin modeling of the network coupling are also discussed. 


Introduction 

The significance of synchronization for the understanding of complex systems became evident to the broad scientihc 
community with the publication of Strogatz’s remarkable book Sync Although the underlying mechanisms can 
be quite varied in different kinds of events synchronization is central in phenomena from the coordinated clapping 
of an audience, to the rhythmic firing of pacemaker cells in the heart, to the syncopated firing of neuronal groups. 
Tognoli and Kelso [5] identify three types of synchrony involving relative phases between coupled regions of the brain: 
an inphase (zero-lag) synchronization; antiphase in which oscillatory elements have the same intrinsic frequency; and 
finally broken symmetry that is near inphase or near antiphase. 

Phase synchronization is not only a fundamental mechanism giving rise to a collective action of large ensembles of 
units found in near proximity to each other, which otherwise would behave according to their individual rhythms, not 
being able to produce a large scale response. [3]. An inphase pattern has been observed in brain activity using fMRI 
measurements within a cohort of patients by synchronizing brain activity across individuals watching the same movie 
[3]. The inphase pattern of the activity in different regions of the brain among different members of the audience 
cohort reveals shared emotional states. 

An antiphase pattern in the absence of a task has been explained by Li and Zhou [5] as a type of background 
organized by the spontaneous cortico-cortical communication dynamics. Their two module coupling calculations 
using both neuron cell and neuron mass models suggest that the antiphase dynamics observed in both is generic. The 
challenge is then to explain the anti-synchronization property independently of specific mechanisms. 

In nature, many complex networks are modular, composed of subnetworks, with varying internal and external con¬ 
nectivity. Here we study the interaction of two modules (networks), both having the same structure and functionality. 
We demonstrate that cooperative dynamics of single units within each module leads to consensus. When coupled, 
dynamic consensus can act to counter the influence of the inter-network coupling, resulting in an anti-synchronization 
of the two networks or it can act to synchronize the cooperative impulse. The response of the two networks to one 
another depends on their internal states and on the symmetry of the interaction. The symmetry of the interactive 
response has been discussed in the context of coupled chaotic systems as an adaptive control scheme 00. Herein the 
symmetry of the interactive networks is the result of a control process that is dependent on the nature of the coupling 
of the networks. From this we establish consistency with the Principle of Complexity Management (PCM) [SI [9], 
thereby suggesting the conditions allowing for maximum information transfer across complex networks composed of 
multiple modules. 

In Section I the decision making model (DMM) is introduced in terms of the two-state master equation. A number 
of the DMM properties are reviewed, such as in the all-to-all (ATA) coupling of the elements in an infinite sized 
network the dynamics of the mean field variable are described analytically by a particle in a double-well potential 
and the magnitude of the potential barrier is a function of a cooperation parameter. For a finite sized network this 
description reduces to a Langevin equation and the strength of the fluctuations scales with the size of the network 
and is also a function of the cooperation parameter. 

The coupling between two ATA DMM networks is considered in Section [[and shown to be equivalent to two coupled 
Langevin equations. The strength of the fluctuations in the Langevin model are estimated from a corresponding 
DMM calculation thereby making the Langevin description empirical. The sign of the coupling terms determines the 
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symmetry of the coupled network, that is, whether the dynamics of the coupled networks are synchronized or anti¬ 
synchronized. Moreover, the conditions under which the maximum information is shuttled back and forth between 
the modules are determined using relative entropy and it is determined that the information transfer is not dependent 
on the symmetry of the dynamics. 

We suggest that in one possible application of the model the individual subnetworks can represent the cognitive 
behavior of individuals trying to make a decision between two alternatives. The potential minima in the Langevin 
model could then be associated with speaking and listening in a two person conversation. The distribution of time 
intervals spent with one person talking and the other listening is herein shown to be inverse power law consistent with 
prior research on turn-taking dynamics in which inverse power law was obtained m- Moreover, Abney et al. |12j 
have shown that the inter-event intervals ranging from phonemes to semantics in dyadic conversations have an inverse 
power law distribution with an index near -2 in keeping with the PCM for the maximum transfer of information 
between two complex networks. 

In Section D we draw some conclusions. 


Methods 


The Decision Making Model 

The Decision Making Model (DMM) implements the echo response hypothesis, which assumes that the dynamic 
properties of a network of identical individuals are determined by singular people imperfectly copying the behavior of 
one another |15j . Formally an isolated individual is modeled as an unit switching back and forth between two states, 
-|-1 and —1, with constant rate go of making a transition at any time. Thus, the probability of finding an isolated 
unit s{t) in one of two states, p(t) = (p+i,p_i) is described by a two-state master equation, 


dv>{t) 

dt 


Gp{t), 


where G is a 2 x 2 transition matrix with constant elements: 


( 1 ) 


G = 


—go go 
go -go 


Here the adopted network structure is that of an all-to-all (ATA) network, in which each individual interacts 

with all other individuals composing the network. The interactions modify the two-state master equation describing 
a single individual (Eq. and lead to a master equation with time-dependent transition rates: 


(t) 

dt 


G«(t)pW(<), 


( 2 ) 


where G*'*^(t) contains the transition rates of switching from state -1-1 to —1, and the rates of switching from 

state —1 to -1-1, 




\-g^l.At) g^^UAt) 1 


(3) 


The probability of individual i being in one of two states (-1-1,—1), is p^®^^) = (p+i)P-i)- Positioning N such 
individuals at the nodes of a network yields a system of N coupled two-state master equations dsnn]. The transition 
rates for each of the i individuals: 


s':i-Ao 

stLJf) 


go exp 


go exp 


-|(7V+i(t)-iV_i(t)) 


(4) 


depend on the the total number of individuals in the state -1-1 and —1, N^i{t) and A^_i(t), respectively. Since every 
individual in the network stochastically chooses their state the total number of individuals within each state, N^i{t) 
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and N-i{t) also fluctuates in time. As the number of the elements in the network increases and approaches N = oo, 
the ratio N±i{t)/N —>■ p±i (t), and the relative frequency becomes the probability that the network is in one state or 
the other. In this limit the transition rates become exponentially dependent on the state probabilities, resulting in 
a highly nonlinear master equation m- The parameter K denotes the strength of cooperation between elements of 
the network, being a measure of the extent individuals copy the behavior of one another. 


Infinite ATA Network 


In an ATA network of infinite size we may introduce the difference variable 11*^®^ = , which reduces the 

two-state master equation for each of the elements in the network to the scalar rate equations 


dt 


= 2go sinh (ATI) — cosh (ATI). 


( 5 ) 


Alternatively we may introduce the global difference variable 11 = p+i — P-i and replace the set of two-state master 
equations with the single expression for the mean field variable 


^ = 2go sinh (AH) - 2gon cosh (AH) = - , 


( 6 ) 


The global two-state master equation (Eq. ^ is equivalent to the over-damped movement of a particle in the potential 


y(n) = 


2go 

K 


n sinh (ATI) ~ ^ ] cosh (ATI) 


( 7 ) 


whose shape is a function of the cooperation parameter K [Hill]. For AT < I, Id(n) has one minimum centered at 
n = 0, denoting the fact that the equilibrium solution to Eq. in this regime is Ileq = 0 and exactly half of the 
individuals in the network are in state -I-1 and half in the state —1. At the critical value Kq = I a bifurcation occurs 
and the potential develops two wells separated by a barrier. The height of the barrier increases with an increase of the 
cooperation parameter K as depicted in Fig. The presence of two equilibrium values neg(Ar), which correspond 
to the minima of the double well potential, reflects the fact that for AT > Kc a majority decision in the system 
emerges, where more than half of the individuals share the same state. The condition of perfect consensus is reached 
for AT —>■ 00 , where 11 converges on either the value -|-1 or —I, for details see [HHS]. 


Finite ATA Network 

In numerical calculations, the states of N individuals composing the network, are first randomly initialized with 
the value of -I-1 or —I. Then, in a single time step the transition rates defined by Eq. |^are calculated, according to 
which each individual is given the possibility to change its state. The procedure is repeated at all consecutive time 
steps. When AT = 0 all units are isolated and switch their state from -|-I to — I and in the opposite direction with the 
transition rate go- When the control parameter increases, AT > 0, a node in state -|-1(—I) makes a transition to the 
state —I(-|-l) slower or faster depending on whether the total number of nodes in state -1-1, iV+i is larger or smaller 
than the total number of individuals in state —1, 7V_i. 

Global decisions of a network composed of N individuals can be defined by the time-dependent global order 
parameter (mean field) as an average state of the network at a given time 

1 ^ 

= —'^Sj{K,t) ( 8 ) 

i=i 

where Sj {K,t) is the value (±1) of the element j of the network coupled to other nodes with cooperation level K. 
For values of the cooperation parameter AT < Kq, single individuals are only weakly influenced by other individuals, 
leading to small amplitude fluctuations of oscillating rapidly about the zero-axis [See Fig. [^. For AT > ATc, 

the interaction between individuals gives rise to a majority state, which recovers partially the dichotomous character 
of the single individuals, however at much larger time scale. 

The time-average of the global order parameter, = (k(Ai, t)|), is used as a measure of the organization of the 
network and an approximation of its equilibrium state. In Fig. ^the calculations of Heq and <;eq are compared and 
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FIG. 1: Over-damped motion of a particle in the double-well potential F(II) is equivalent to the behavior of 
the mean field variable 11 (Eq. |^. (left) The double well potential E(n) as a function of the difference variable II for 
three increasing values of the cooperation parameter K. An arrow marks the intensity of the barrier created between wells. 
(right) The equilibrium value of the difference variable Ileg, as a function of the cooperation parameter K. The thick line is 
the theoretical solution obtained by solving dH/dt = 0. The dots correspond to the numerical evaluation of Ceg for all-to-all 
network oi N = 1000 nodes. In both cases the unperturbed rate is go = 0.01. 


found to be essentially the same quantity, the difference being due to the finite number of elements in the numerical 
calculation. Thus, the global dynamics of the DMM is characterized by a phase transition with respect to the 
cooperation parameter K, demonstrating that a network of identical imitating individuals is able to reach consensus, 
given sufficient influence of the imitation on their decisions. 


Langevin Formalism for Finite ATA Network 


In a network of finite size the mean field approximation is no longer exact and we replace 11 in Eq. [^with 

N+ it) - N_ (t) 


N 


= aK.t) + f{K,t)=giK,t) 


(9) 


where / (K, t) is a random fluctuation induced by the finite size of the network, whose magnitude is proportional to 
I/'/N. When the network size increases, N —)■ oo, the frequencies N±iit)/N collapse Into probabilities, N±iit)/N —> 
P±i {t), and the global order parameter g{K,t) = —>■ n(t). 

Using this new value of the global variable Eq. [^becomes the nonlinear Langevin equation [13 [H] 


^ = 2gosinh{K^ + Kf) -2goii + f)coshiK^ + Kf) 


dViO 

dC 


■v{t) 


( 10 ) 


where r]{t) is a random function given by r]{t) = afiK,t) and the potential is given by Eq. 

The strength a of the random force is determined by the equilibrium properties of the numerical realization of the 
DMM dynamics. We approximate the random force by a white noise Gaussian process whose strength is cr = \/2D 


and D is an unknown diffusion coefficient. The Langevin equation given by Eq. 10 has an equivalent Fokker-Planck 
equation (FPE) description 


dt 




dViO 


Pi^,t) + D 


dPjU) 


( 11 ) 


for the probability density function (PDF). The equilibrium solution to the FPE is obtained by setting the time 
derivative to zero to obtain the equilibrium distribution for the mean field variable 
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FIG. 2: Global order parameter <;{K,t) evolution and corresponding probability distribution P(C)- (^sft) Temporal 
evolution of the mean field variable ‘;{K, t) for K — 0.95, K = 1.00 and K = 1.05 is presented on upper, middle and lower panel, 
respectively. Network size is N — 1000 nodes and go = 0.01. (right) Thin line depicts corresponding equilibrium probability 
distribution Pig). Dashed line denotes the best fit by Eq.(|12[). 


Pe, (0 


^exp 


D 


( 12 ) 


and Z is the normalization. 

The value of D is determined numerically from the mean field generated by the DMM of size N, with cooperation 
parameter K and transition rate g^. Using a long time realization of c iK,t ), the equilibrium PDF can be estimated 
as depicted in Fig. The resulting histograms are fit with Eq. |12[ where D is kept as an unknown parameter 
that optimizes the fitting. Fig. [^presents the dependence of numerically obtained values of D on the cooperation 
parameter K and size of the network N. It is well known from the law of large numbers that the intensity of the noise 
ought to decrease as . Using this as a starting point we obtain an empirical expression defining the dependence 

of D on iT and N: 


D = 


2go 

fiexp [-^(K-l)] 


K <Kc 
K>Kc 


(13) 


whose excellent overlap with values of D in two domains, K < Kq, where the value of D is constant and independent 
of the cooperation parameter, and K > Kc, where D decreases exponentially with K, as depicted in Fig. 

Now one can adopt the Langevin equation (Eq. [l0| to quantitatively simulate the dynamics of the DMM on a finite 
size ATA network. For given N, K and t/o Eq. |10| is numerically integrated using the Euler-Maruyama algorithm 
for integration of stochastic differential equations. The simulation time step is h = 0.01. The comparison of the 
fluctuations of the global order parameter g{K,t), resulting from the DMM dynamics defined by Eq. and the 
fluctuations of the mean field ^(AT, t), resulting from the solution to the Langevin equation with matching parameters 
is presented in Fig. The visual similarity of both time series is further confirmed by the comparison of their 
statistical properties. We quantify the changes in temporal properties of c(Ar, t) and ^(AT, t) by evaluating the waiting 
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FIG. 3: Dependence of the diffusion coefficient D on the cooperation parameter 
increasing size. Dashed lines represent analytic expression for D, Eq.(13l. Note that the 
coefficient is logarithmic. 
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time PDF ipir) and corresponding survival probability function, 

/ OO 

(14) 

of time intervals r between consecutive crossings of the zero-axis by and The statistical properties 

of the global order parameter have been extensively studied for subcritical {K < Kc), critical {K « Kq) 

and supercritical {K > Kq) regime of values of the cooperation parameter |13L I15j . Briefly, in the subcritical regime 
'I'(t) has an exponential form, which reflects the largely independent nature of individuals. The critical region is 
characterized by an inverse power law decrease of 4'(t), whereas in the supercritical region long majority intervals 
are responsible for an exponential shoulder present in 4'(t). From the comparison of respective survival probability 
functions [See Fig. it is evident that the Langevin equation reproduces all the global dynamic properties of the 
DMM network dynamics, throughout the range of values of the cooperation parameter K. 


Results 

In this section we consider the interaction between two ATA DMM networks each of which is modeled by a Langevin 
equation with a double-well potential. The symmetry of the response of the combined network depends on the choice 
of coupling between the sub-networks, which we explain in detail. Section [] presents a approximation technique for 
modeling the coupling between the two networks through a modification of the individual switching rates in terms 
of the fraction of individuals within a network that are sensitive to the state of the other network. It is shown in 
Section [] that the sign of the perturbative coupling between the two networks leads to either synchronization or anti¬ 
synchronization of their relative dynamics. The relative entropy is used to determine that the conditions under which 
the maximum information is exchanged between the two networks. The limitation of the coupled Langevin model as 
an approximation to the coupling between two ATA DMM networks is also discussed. 
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FIG. 4: Comparison of the global behavior of an all-to-all network of = 1000 nodes with the solution to the 
corresponding Langevin equation, (left) Temporal evolution of mean field variable (top part of each panel) is compared 
with the numerical integration of Eq.( |10| l (bottom part of each panel). Adopted values of cooperation parameter are K = 0.50, 
K = 1.00 and K = 1.06 for the top, middle and bottom panels, respectively, (right) The comparison of the survival probabilities 
of time intervals between consecutive zero crossings for both variables. Straight and dashed lines correspond to the DMM and 
the Langevin case, respectively. 


Network Response 

The response of the ATA DMM network to external forces was analyzed by Svenkeson m and we follow that 
discussion closely in this section. We assume that a subset of individuals within the group are sensitive to external 
influences and that they relay the information obtained through this sensitivity to the free individuals in the network 
(free from external influences). These latter individuals behave in the normal DMM fashion previously described. 
The total number of individuals in the network N is the sum of those that are free n and those that are driven by 
the external force I, N = n 1. Consequently, in the presence of sensitive individuals the transition rates governing 
the ATA network dynamics of the free individuals are 


9+^{t) = 9 oexp[-K[{l-P)x +Psi]]-, 

9^+{t) = 9 oexp[K[{l-P)x +Psi]] (15) 

where the fraction of sensitive individuals is P = -^ and the fraction of free individuals is 1 — P = . The mean field 

for the free individuals alone is given by 


1 " 

{K,t) = - = 


n+ {K, t) — n_ {K, t) 


(16) 


i=i 


The two-state master equation for the mean field coupled to an external force is therefore given by 

^ = 2^0 [sinh (ATpa;) — n cosh (ATpcc)] cosh (ATPsi) 

-|-2go [cosh [Kpx) — n sinh (ATpa:)] sinh (ATPsi) 
with the new control parameter Kp = {1 — P) K. 


( 17 ) 

























FIG. 5: Coupling between two ATA networks is realized by letting a fraction of nodes of each network sense 
the mean field of the other network. 


Two Coupled Networks 

Here we extend the discussion of the network response to external forces to the case when the external influence 
originates from another ATA network. Additionally, we assume that the second ATA network is in turn being 
influenced by the very network it exerts its influence on, thus leading to bi-directional coupling of two ATA networks 
[See Fig. [^. Taking advantage of the demonstrated equivalence between the dynamics of the DMM on an ATA 
network and the solution to the matching Langevin equation, we study the coupling of two ATA networks by means 
of the coupled Langevin equations 


d^i 

dt 

d^2 

dt 


d^i 

dV{^2) 

d^2 


+ r]i (t) ± a^2 
-I- r]2(t) ± 


(18) 


where a is the strength of the coupling between networks and the choice of sign determines the symmetry of the 
interaction. Thus, in the model one considers the intra-network coupling between elements of single ATA network, 
the cooperation parameter K, and the inter-network coupling ia, denoting the mutual influence between networks. 


Symmetry of interaction 

The positive sign for the interaction terms in Eq. leads to a synchronized response of the two networks. This 
is observed in Fig. where the temporal fluctuations of the mean field ^i{Ki,t) and ^ 2 ( 1 ^ 2 ,^) and their statistical 
properties are compared between uncoupled (a = 0) and coupled case. In the uncoupled case (Fig. [^) the disparity 
between the the behavior of and ^ 2 {K 2 ,t) is clearly visible, since the subcritical system is characterized by 

random fluctuations, while the supercritical system demonstrates the onset of dichotomous dynamics. When positive 
coupling is turned on, it is evident that although not in lock step the two networks are synchronized (Fig. [^). Variable 
is being visibly influenced by coupling to ^ 2 {K 2 ,t), exhibiting dichotomous dynamics, and although it does 
not match ^ 2 {K 2 ,t) in amplitude, it follows the switching dynamics of ^ 2 ( 1 ^ 2 , t). The joint probability distribution for 
both variables, ^’(^ 1 ,^ 2 )) provides additional evidence for the synchronization between systems, being characterized 
by two peaks, corresponding to the situation when both global variables simultaneously attain positive or negative 
values. The coupling effects are visible also in the effective increase of cooperation parameters K for both networks. 
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FIG. 6: The coupling of two Langevin equations. The cooperation parameters are K\ = 0.90 and K 2 = 1.05 for the 
two networks, and a = 0.001, with positive sign (left), with negative sign (right). A) The global variable fluctuations for the 
uncoupled case. Top panel (blue line) corresponds to Ki, while bottom panel (red line) corresponds to K 2 . B) The distribution 
of waiting times demonstrates the change introduced by coupling to the dynamics of both networks. C) Synchronous coupling 
of two networks. D) Antisynchronous coupling of two networks. In both cases top panel (light blue) corresponds to system Ki 
and bottom panel (pink) shows the behavior of system K 2 . E, G) The joint probability distribution for the coupled variables 
F) Gomparison of single variable probability distribution between the coupled and uncoupled cases. Synchronous 
and antisynchronous coupling of the same strength result in the same probability distributions. 


When compared with the uncoupled case, the probability distributions of the global variables, P{^i) and P{^ 2 ), 
demonstrate stronger bimodality, especially evident for the ^i{Ki,t) variable, whose original distribution is unimodal 
(Fig.[§?). 

The negative sign for the interaction terms in Eq. leads to an anti-synchronized mutual response of the two 
networks, observed in Fig. |^. It is again evident that although not in lock step the two networks are negatively 
synchronized. The probability distribution of global variable T’(^i) is clearly unimodal in the absence of coupling and 
bimodal when the mutual interaction is turned on (Fig. [^). The P{^ 2 ) is affected less significantly, with the bimodal 
peaks being shifted towards higher values.of ^2 as a result of the coupling. Due to the the fact that the coupling a 
differs only in sign between the synchronized and anti-synchronized case, the obtained probability distributions are 
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indistinguishable. The presence of the bimodality is clearly indicated in the shape of distribution P (^ 1 ,^ 2 ) (Fig. 1 ^) 
and here is where the effect of the sign of the mutual coupling is most evident. The anti-synchronization is manifest 
by the two networks peaking oppositely, when one global variable is positive the other is negative and vice versa. 

Let us look in more detail at the reason for the anti-synchronization. 


Anti-synchronization 

In numerous studies m the coupling of stochastic oscillators represented by the Langevin equations leads to network 
size resonance, when the ensemble of oscillators respond to a periodic forcing in a fashion similar to the stochastic 
resonance phenomenon. In our case however, the weak coupling of two Langevin equations results in non-resonant 
behavior. In particular, the coupling causes an effective increase of the cooperation parameter K in both networks, 
regardless of the sign of the coupling. 

A visual inspection of the temporal fluctuations of the mean fields ^i{Ki,t) and ^ 2 {K 2 ,t) presented on Fig. 
demonstrates the change in the dichotomous character of both networks, with the increased sojourn in the majority 
states visible in and ^ 2 {K 2 ,t), when compared to the uncoupled dynamics (Fig.J^). Longer waiting times 

induced by the mutual coupling affect the survival probability function as well. In Fig. we see that the inverse 
power-law regime of the survival probability is not changed. The difference in 'l'(r) due to the coupling increases the 
extension of the exponential shoulder, which in an uncoupled case would correspond to a larger cooperation parameter 
K. Thus, individuals present in each of the two coupled ATA networks perceive the coupling as an effective increase of 
the level of intra-network cooperation. Since the sign of the coupling a changes only the nature of synchronization, the 
synchronized case presents the same change to the survival probability functions as the anti-synchronized coupling. 

Of most significance is the observation that the two time series are statistically anti-synchronized. Consequently, 
when the mean field ^i{Ki,t) is in the positive state the probability is greatly enhanced that the mean field ^ 2 {K 2 ,t) 
is in the negative state and vice versa. The anti-synchrony effect can be understood in the following way. Consider 
the potential for network one with the interaction term V (^ 1 ) -I-Q!^i^ 2 - When a = 0 the potential is symmetric around 
^1 = 0 and we have the uncoupled case of the network being in either consensus state with equal frequency. However 
when a 7 ^ 0 and ^2 < 0 the network one potential becomes asymmetric with the deeper well being on the side > 0 . 
This biasing of the potential [See Fig. results in the mean field time series for network one being in the positive 
state. In this case of > 0 consider the potential for network two V (^ 2 ) + This latter potential is biased 

by the mean field of network one and is now also asymmetric. With > 0 the deeper well in network two is for 
^2 < 0 resulting in the mean field for network two being in the negative consensus state. However the two networks 
are not locked in these relative states. The fluctuations are seen to be substantial and when they are sufficiently 
large to induce a phase transition in one network the inter-network coupling induces a corresponding change in the 
dynamics of the other network. This intermittent rocking of the two potentials produces the anti-symmetry of the 
two time series observed in Fig. 



FIG. 7: Symmetric double well potential of the uncoupled networks (dashed curve) become mutually biased 
when weakly coupled to one another (see discussion in text). 
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Information Exchange 


A topic of considerable interest are the parameter values at which the maximum information exchange between the 
interacting systems takes place. One measure of this exchange is the relative entropy S defined here in terms of the 
mean fields of the two networks 


S = So- I log 2 


p^^UC)p^^UC) 




(19) 


The relative entropy relates the entropy of the coupled networks, expressed by the joint probability distribution of 
mean fields in the coupled case, P to the entropies of the individual uncoupled networks, denoted by 

probability distributions for uncoupled variables, P ) and P {^ 2 ^) ■ The constant Sq denotes a reference state. 

The values of the relative entropy calculated for the coupled Langevin equations model with a wide range of 
cooperation parameters Ki (for ^i{Ki,t) variable) and K 2 (for ^ 2 {K 2 ,t) variable) are shown on Fig. The mirror 
symmetry of S{Ki^ K 2 ) with respect to the Ki = K 2 line is due to the symmetric nature of the coupling between 
the two Langevin equations in terms of the PDF’s. Additionally, as demonstrated on Fig. [^, since the PDF’s do 
not depend on the sign of the coupling between two networks, the values of relative entropy are identical both for 
synchronous and anti-synchronous coupling. 

The concentration of highest values of S{Ki , K 2 ) near ATi « 1 clearly indicates that maximum transfer of information 
between the two networks occurs at the critical value of the cooperation parameter Ki ; an observation consistent with 
the PCM [5]. In the regime where both cooperation parameters are subcritical, Ki,K 2 < Kc, the relative entropy 
S{Ki,K 2 ) values are small, implying a lack of effective coupling between the two networks. When Ki,K 2 > Kq, the 
values of S{Ki, K 2 ) are relatively high, although smaller then maximal, indicating that the intra-network dynamical 
organization facilitates the cooperation between networks. It is worth pointing out that the peak in value of the 
relative entropy disappears when both Ki = K 2 = 1, indicating that there is no preference for information transfer 
when both networks are at criticality. 
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FIG. 8: The values of relative entropy S{Ki,K 2 ) of Eq.(19) are color coded for each pair of cooperation pa¬ 
rameters Ki and K 2 - Coupled Langevin equations were numerically integrated with N = 500 and go — 0.01. The coupling 
strength is a = 0.001. 
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Furthermore, the effective influence of the coupling between networks depends on the strength of the coupling 
term. The values of relative entropy obtained for increasing the coupling strength a reinforce the observation that 
the transfer of information is maximal once one network is in the critical regime [See Fig. |^. The values of S initially 
increase with the increase of cooperation parameter Ki, to reach maximum at Ki « 1. This peak is followed by 
a decrease of S and a region of Ki in which the relative entropy is constant suggesting that the two-point PDF is 
proportional to the product of the singlet PDF’s, P = P (^P^) P (^P^)- If Hiis ratio is denoted by C, 

then the change in the relative entropy is given by 

A5' = -Clog2C' (20) 

and the constant C is a function of the control parameters C{Ki, K 2 ). In addition to the dependence on the control 
parameters through C the relative entropy is seen to decrease disproportionately with the coupling strength. 
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FIG. 9: Coupling of two Langevin equations is compared with coupling of two all-to-all networks. Values of the 
relative entropy for increasing strength of coupling a between two Langevin equations (left) are compared with values of the 
relative entropy obtained for two connected networks (right). In both cases N = 500 and go = 0.01 and Ko = 1.20. The sizes 
of the fraction of sensitive nodes adopted for the coupling of two ATA networks were increasing from P = 0.01 to P = 0.05 for 
increasing values of a. 


Validity of Langevin Formalism 

The discussion of the external influence exerted on the network through a small fraction of its members presented in 
Section[]can be adopted to treat the weak coupling between two networks realized with the Langevin equation model. 
In that case one considers two ATA networks of size Ni and N 2 , whose intra-network dynamics is realized with the 
cooperation levels Ki and K 2 , respectively. Here for simplicity we choose Ni = N 2 . Next the dynamics of a fraction 
1 — P of the free individuals is realized following the rules of normal DMM dynamics, adopting the expressions for 
the transition rates defined by Eq. The fraction P of sensitive individuals obey the modified transition rates 


5 +L_i(0 = go exp -h C 2 ]; (21) 

= go exp [ATi-ji - <^ 2 ] (22) 

where the additional term in the exponent comes from the coupling to the second network. The transition rates defined 
for the dynamics of the sensitive individuals in the second network contain opposite indices. With the introduction of 
the difference variable as before, H^*) = —P-\, the 1 — P two-state master equations describing the free individuals 

reduce to Eq. and the P sensitive individuals are described by 
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dt 


2gQ sinh — 2 ( 7 on^*^ cosh (-RTiII) — 25 o<? 2 - 


The dynamics of the global variable for one network is then 


(23) 


^ _ 1 A 

dt N dt 

i—1 


dV{gi) 

d^i 


+ m{t) - ‘^9oP‘i2{K2,t) 


The correspondence with the coupled Langevin equation occurs when the coupling is a = ^g^P, denoting the fact 
that in a particular realization weak coupling between two networks can be obtained by making a small fraction of 
individuals of each network sensitive to the dynamics of the second network. 

The effect of the coupling of two ATA networks realized through sensitive individuals is demonstrated in Fig. 
where the values of the relative entropy for increasing values of the coupling strength a are compared with the 
Langevin equation model. We observe the same qualitative behavior as in the Langevin models, that is, the maximum 
information transfer occurs at criticality, and the values of the entropy saturate in the supercritical cooperation 
parameter regime. 





Order parameter, C, Order parameter, t, 



FIG. 10: The coupling of two networks results in an effective increase of the cooperation parameter character¬ 
izing the dynamics of each network. This effect can be observed by the shift in location of the maxima in the PDF for 
the mean field variable. Coupling of the two Langevin equations and (right) coupling of two ATA networks is considered. 

In both cases top panels demonstrate the PDF’s for uncoupled networks. Middle panels demonstrate the effect of coupling, 
a = 0.001 (left middle panel) and a = 0.01 (right middle panel), on the shape of the PDF. Bottom panels show the dependence 
of the equilibrium value of the mean field as a function of the coupling strength a. The size of both networks is A = 500 and 
go = 0.01. The cooperation parameters are K\ = 0.80 (blue and light blue lines) and Ko = 1.20 (red and pink lines). 

Finally, one needs to consider what is the range of validity in which the coupled Langevin model recovers the 
dynamics of two ATA networks coupled with a small number of links. One significant difference between the direct 
numerical simulation of an ATA network with DMM dynamics and the realization of the corresponding Langevin 























14 


equation is the fact that in the DMM the mean field variable is always limited to the range ±1, while the 

variable present in the Langevin equation is not so restricted. Thus, we adopted the value of a at which 

^{K,t) observed for the coupled networks is larger than either +1 or —1 as the measure of the validity limitation for 
the equivalence of the two approaches. 

We investigate the properties of the PDF of the Langevin variables and ^ 2 {K 2 ,t), and that of the DMM 

variables, <ji(iFi,<) and ^ 2 {K 2 ,t). We concentrate our attention on the equilibrium value of ^ 1^2 and ci^ 2 j which 
corresponds to the location of the maxima of the PDF’s for those variables. The approach is illustrated on Fig. [TO} 
where the PDF’s obtained for weak coupling, a = 0.001 are compared with those obtained for stronger coupling, 
a = 0.01. In the case of weak coupling both approaches lead to identical PDF’s. However, stronger coupling in the 
case of coupled Langevin equations results in the peaks of P(^i) and P{ii) to be located outside the range — 1 < ^ < 1, 
which violates the underlying assumption for the mean held dynamics. This behavior is not observed for coupled 
ATA networks independently of the strength of the coupling. 

The position of the equilibrium values of ^ 1,2 and <ri ^2 for a wide range of a values is also plotted. One determines 
for coupling strengths a < 10“^ that the coupling does not result in any effective change in either network, being too 
weak to inhuence the intra-network dynamics. Additionally, coupling values larger than a > 10“^ do not recover the 
correspondence between the direct simulation of the DMM and the Langevin approach. 


Discussion and Conclusions 

Herein we have shown that two weakly coupled ATA DMM networks each modeled with a two-state master equation 
can be approximated to a high degree of accuracy by two Langevin equations each with a double well potential that 
is biased by the interaction with the other network. When the percentage of elements within the network that is 
sensitive to the other network is sufficiently small the coupling can be treated as a perturbation resulting in the 
symmetry of the mean held for the composite network that depends on the sign of the interaction term. 

The sign choice leading to anti-symmetry of the dynamic interaction between these two ATA DMM networks makes 
one think of the adolescent inhghting between two political groups that are oppositely polarized. As long as one party 
holds a particular point of view the other party adopts the opposite point of view. Moreover there is no reconciling 
them, when a huctuation induces one group to change its position this change immediately induces a corresponding 
reaction in the other group to change its position as well. Consequently, the weak coupling between the two groups 
prevents them from ever reaching accommodation. 

Furthermore the interaction between two systems leads to an effective increase in the intra-cooperativity of each of 
them. The dynamics of coupled networks is reminiscent of the dynamics of a single ATA network with a cooperation 
parameter larger than the one characterizing the interacting subnetwork. Using the interpretation of political parties 
sharing the national stage, this corresponds to each of them becoming internally more uniform and orderly, eliminating 
diverse point of view within the group and becoming more radical in the opinions they hold. 

In addition the anti-synchronization mechanism can also model desirable behavior. In the case of two well-behaved 
individuals carrying on a conversation, they politely take turns between talking and quietly listening. The distribution 
of time intervals between turn taking has been shown to be inverse power law m with an index that is larger than 
the value of 1.5 found in the coupled Langevin model. An index close to the value -2 that characterizes the optimum 
transfer of information between two complex networks as predicted by the PCM [8] was obtained by Abney et al. [12] 
for the inter-event distribution function. However detailed comparison of the present results to experiment remains 
to be systematically carried out. 
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